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{*)© Method and system for a robot path. 
CD 

°© A method and system for correcting a programmed robot manipulator path to compensate for variability _of 
S^e location of a succession of workpieces includes the steps of sensing and measuring path offsets between the 
8 dealLd workpiece location and the actual location of the workpiece at a plurality o \^^^^^J^ 
"measured offsets into translations and rotations of the workpiece by multiplying . matrix comprised of the off set 
° measurements by a previously prepared conversion matrix, correcting the coordinates * 
^preprogrammed path by applying the translations and rotations to such coordinates — h * 
m preprogrammed path coordinates into machine control coordinates, and providing a controller for the robot 
manipulator with such machine control coordinates. 
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METHOD AND SYSTEM FOR CORRECTING A ROBOT PATH 



This invention relates to a method and system for correcting the preprogrammed path of a robot 
manioulator to compensate for variability in the positioning of a workpiece. 

rScra of different types of robot manipulators is used in the industrial setting for perform.ng a 
varied rtask 5 such as spray painting, spot welding, sealing, parts picking, and other operates A 
rmmon setng involves th'use of a robot manipu.ator to ^^™?^W*»c^ 
of workpieces. This requires that each workpiece be received into the workstation of the robot and be 
fivtnrpH in olace durina the robot's operation upon the workpiece. 

S^lr^ leno^ by industrial robots, such as spray painting, do not requ-re fine ^accuracy 
in terms of the positioning of the workpiece vis-a-vis the robot. Other types of operations such as sealant 
p So however, require that considerable precision be maintained in terms of the path swept by he 
robot in rela«on to the workpiece. Such precision may be obtained in two bas.c manners. Rrst. the 
workpiecJ may be fixtured in place by means of a rigid holding mechanism. Although such mechan.sms w.ll 
qenerSly pToduce acceptable results in terms of the placement of adhesives or other matenals upon a 
SS^r^equiiHirit usually has an undesirab.e characteristic inasmuch as the t,me requ.red for 
fixturina the workpiece adds appreciably to the total cycle time required for the operat.on 

ratern^ve to rigid fixturing of a workpiece involves placement of the workpiece ,n the approximate 
nositon required for the given operation followed by correction of the robot path to compensate for 
SevSonsTom thf idealised location of the workpiece. This is generally accomplished m a two-step 
proTeS with the first step involving sensing of the precise location of the ^^^^SlStSS 
of the robot path based upon the results of the sensing step. U.S. Patents 4.017.721, 4.146,924. 4.380 69 6 
4 4^2 053; and 4,575.304 a., disclose various details of systems which may be used for tbe purpose of 
sensing the position of a workpiece. These systems do not include a path correct.cn method o the type 
dSed herein. U.S. Patents 4.432.063 and 4,433.382 disclose robot manipulators and control systems 
providing for movement of a robot manipulator on a piecewise digression from a preprogrammed path 
SwTd by resumption of the program path. These systems do not include a ^ * 
pa h in the wholesale fashion taught by this specification. Finally. U.S. Patents ^^^^l 
Sisclose methods and systems for sensing the placement of a workpiece and for cor ectmg th path of a 
robot manipulator based upon the location of the workpiece. The systems disclosed ,n the 878 and I 847 
patents require the solution of simultaneous equations by numerical techniques ,n order to obtam location 
Sata defining ^ the position and attitude of the workpiece with respect to a fixed coordinate system. Such a 

method is both costly and time consuming. ^ mar i 

It is an object of the present invention to provide a method and system for corrects , a preprogrammed 
robo manipulator path to correspond with the various locations of a succession of workp,eces w. hout the 
need for living excessive numbers of equations each time a workpiece is docked into the mandator's 

^'Vistn advantage of the present invention that a method and system according to this invention will 
allow SDeedv correction of a robot path with economical usage of computer resources. 

ft is alurthe^ Advantage of the present invention that a system operating according to this ,nvent.on .s 
able t usl Tsmall number of measurement points, for example, one or two points. *P^<*»*» 
woe of operation being performed, the architecture of the workpiece and the type of workp.ece fixtunng 
r P .oyed P Two points^ provide a sufficient amount of data for the ^ 

straight seam located on a workpiece. In contrast, the systems d.sclosed in the 878 and 647 patents 
always require data from at least three measurement points. , aaMn „ 
Otter objects, features and advantages of the present invention will become apparent to those read.ng 

thiS AccoS°to the present invention, a method for correcting a programmed path for a <<*«™^ 
to compensate for variability in the location of a workpiece comprises the steps of sensmg and measurmg 
offsetT between the idealized .ocation and the actual location of the workpiece at a plural. ty of po.nts. 
converting such measured offsets into transitions and rotations of the workpiece by "*"^« 
comprised of the offset measurement by a previously prepared conversion matnx. correcting Mh. coords 
Stes of waypoints within the programmed path by applying such translates and rotations tc sa.d 
coordinates aSd transforming the corrected preprogrammed path coordinates ,nto S 
coordinates Thereafter, the method further includes providing a controller for the robo man.pulator w.th 
Machine control coordinates. The offsets may be measured at a plurality of ^^T^ 
a path to be traversed by the robot manipulator. The conversion matnx used .n th.s method .s formed 
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according to the steps of converting machine control coordinates corresponding to a plurality of waypoints 
along an idealized motion path for the robot manipulator into world space coordinates and unit measure- 
ment direction vectors, followed by arrangement of a measurement matrix having rows comprised of the 
components of the unit measurement direction vectors and the components of the vector cross-products of 
5 world space coordinates and the unit measurement vectors and finally, inverting such measurement matrix. 
The measurement matrix may be inverted according to several methods including the decomposition 
method. 

A system for correcting a programmed path for a robot manipulator to compensate for variability in the 
location of a workpiece according to the present invention includes means for sensing and measuring path 

io offsets between the idealized location and the actual location of a workpiece at a plurality of waypoints, and 
means for converting such measured offsets into translations and rotations of the workpiece by multiplying 
a matrix comprised of such offset measurements by a previously prepared conversion matrix. A system 
according to this invention may further include means for correcting the coordinates of waypoints within the 
preprogrammed path by applying such calculated translations and rotations to such waypoint coordinates, 

75 and means for transforming the corrected preprogrammed path coordinates into machine control coordi- 
nates and for providing a controller for such robot manipulator with such machine control coordinates. The 
means for sensing and measuring the path offsets in a system according to the present invention may 
comprise a single structured light device which projects a plane of light upon the workpiece and determines 
the position of the workpiece. 

20 The invention will now be described further, by way of example, with reference to the accompanying 
drawings, in which : 

Figure 1 is a schematic representation of a robot manipulator and control system according to the 
present invention. Figure 1 illustrates a world coordinate system and unit measurement vector system which 
may be employed with a path correction scheme according to the present invention. 
25 Figure 2 is a flow diagram pertaining to the formation of a conversion matrix according to the present 



Figure 3 is a flow diagram illustrating a system according to the present invention operating in the 
"run" mode. 

Figure 1 contains a schematic representation of a robot manipulator 10 including end effector 12. The 
30 end effector may comprise a sealant application gun, a paint spray gun, a welding device, a drill, or other 
types of tools known to those skilled in the art and suggested by this disclosure. In the present case, robot 
manipulator 10 is shown as causing end effector 12 to traverse workpiece 18 along locus of end effector 
operation 19. Locus 19 could comprise, without limitation, a weld seam, a seam to which sealer is to be 
applied, or a region which is to be machined by end effector 12. 
35 Camera 14 and laser light source 16 are mounted adjacent to end effector 12. Although a laser light 

source is described herein, those skilled in the art will appreciate in view of this disclosure that similar 
structured light devices which project a plane of light upon the workpiece could be employed in practicing 
the present invention. 

Laser light source 16 projects a plane of light which intersects with workpiece 18 along line 23 of Figure 
40 1. Camera 14 works in conjunction with microprocessor 20 to determine the offset of locus 19 by a 
triangulation method, for example. Such methods are known in the art to which this invention pertains and in 
general involve storing an idealized image of the workpiece, which is compared with an actual image which 
is created as camera 14 views the workpiece, including locus 19 at a 45 degree angle from the plane of 
laser light. U.S. Patent 4,188,544, which discloses a method and apparatus for determining the offset 
45 location of a workpiece, is hereby incorporated by reference into this workpiece, is hereby incorporated by 
reference into this specification. 

Once camera 14 and microprocessor 20 have determined the offset measurements for a minimal 
number of measurements at several locations, a system according to the present invention will then be able 
to correct the preprogrammed robot path. This is performed as follows. First, as shown in Figure 3, after the 
so path offsets have been measured at block 32, the program within microprocessor 20 moves to block 34 
wherein an offset array is formed. The offset array has the following form: 
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Here two measurements. Ay and Az. have been taken at each of three measurement po.nts. These two 
measurements, Ay and Az, are the offsets' of the point where a seam or edge contained .n a workpiece 
intersects the light plane along the y and z axes, respectively, of the camera coordinate system The y and 
z axes are perpendicular to the seam and the x axis is parallel to the seam. It should be emphasized that 
this methodology uses the offsets of the point where a seam intersects the light plane instead of a fixed 
point on the seam. As a result, the offset x of a fixed point, which cannot be measured, is not needed. A 
method and system according to the present invention may be employed with as few as a single 
measurement point, or as many as twenty or more points. Although a few points may be adequate for 
simple structures such as linear seams, more complex structures such as an automob.le door may require 
5 or6 points. Those skilled in the art will appreciate in view of this disclosure that the use of additional 
points may require additional travel of the camera to added locations, which will, of course, increase the 
cycle time of the operation being performed by the robot. 

Those skilled in the art will appreciate in view of this disclosure that a method according to the present 
invention could be practiced either with the disclosed single camera and structured light source or with 
multiple stationary cameras in conjunction with either structured or unstructured light. It w.ll further be 
appreciated that offsets could be measured at any point on a workpiece comprising a rigid body. 

Following formation of the offset array the computer moves to block 36. There the offset arrays 
multiplied by a previously prepared conversion matrix "M" to yield a six component vector. The vector has 
the following form: 



Px 



d = 



so 



ss 



where p x . p y . and p, and x . y and, represent the three-dimensional offsets and rotations of the- workpiece 
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* 0m ZTX^ matrix mutation, the program within microprocessor 20 moves to blocK 38. 
wherein correction matrix T is formed according to the following arrangement. 
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Having formed correction matrix T. the computer 
idealized robot manipulator path, as set 

each of the preprogrammed coordinates by matnx T. ™e corr e cted hods {or perform ing this 

at block 42 to machine control coordinates using any one * J**"*" °™ £ s authored by 
operation. One such method is described in "Kinematics of Mjor Robot Jj^^onal Symposium on 
the present inventors and which was published ,n the ?* S^EThST Finally, at b.ock 

Industrial Robots. 1983. Volume 2. This article ,s hereby -^P 0 ^^,^ ^Ta Microprocessor 20 so that 
44 the corrected machine control coordinates are sanT ^^^^^Z jhe steps contained 
the robot's end effector 12 may be guided preasely along^ ocus 19 «n wor P^™^ m P anipuiator is 
within blocks 40-44 are repeated for each of ^ ^^J^^^^^.t,,^ with b.ock 
programmed to traverse. With each new workp.ece, the entire sequence .s repeaiea. y 

32 - Preparation of conversion matrix -M- is performed during a 

Because the conversion matrix is formed only once. T£ £2E « *• machine 

invention provides an economical use of ^"^^ 

control coordinates to compensate ^'^^^^^S^L of solutions requiring the 

ssr*s^^ t between a prepro9rammed 

obot path and the path necessitated by the actual orientation of a workp^ 

The first step in the formation of ^nvers.on ma "x M ffe ^T 2 ^ everted 7n« world space 
machine control coordinates of the expected path of °" d J*°^ pa th of end 

coordinates and unit direction vectors for a ^nes °f ^ypo.nts P^ s f ,b,n 9 ^ 3 P m P easurement 
effector 12. The world , space .coordinates ave the ^ n ^J^^£ m = 1>2 , ... 2n . Figure 1 
direction vectors have the form u m - (u xm . u ym , u»>. for n meas ^ systems used 

matrix is formed as follows: 
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20 



■ [ti mi ]= [Uxm. u ym , u OT , u atl y m *-u yro 2 m ', u xm z m --u 2m x m *. u yra x fn '-u )(m y m ']. 

■J Note that there are 2n rows in the measurement matrix. For example, for two measurement points there 

are four rows in the measurement matrix. 

Finally, at block 28 measurement matrix H is inverted to form conversion matrix M. This inversion may 
5 be done according to a variety of methods known to those skilled in the art and suggested by this 
disclosure. However, the decomposition method which is known to those skilled in the arts to which this 
invention pertains has proven to be useful for performing this operation. 

jo Claims 

1. A method for correcting a programmed path for a robot manipulator to compensate for variability in 
the location of a workpiece. comprising the steps of, sensing and measuring offsets between the idealized 
location and the actual location of said workpiece at a plurality of points, converting said measured offsets 
into translations and rotations of the workpiece by multiplying a matrix comprised of said offset measure- 
ments by a previously prepared conversion matrix, correcting the coordinates of waypoints with.n said 
preprogrammed path by applying said translations and rotations to said coordinates, transforming said 
corrected preprogrammed path coordinates into machine control coordinates, and providing a controller for 
said robot manipulator with said machine control coordinates, wherein said conversion matrix is formed 
according to the steps of, converting said machine control coordinates corresponding to a plurality of 
waypoints along an idealized motion path into world space coordinates and unit measurement direction 
vectors, arranging a measurement matrix having rows comprised of the components of said unit measure- 
ment direction vectors and the components of the vector cross-products of said world space coordinates 
and said unit measurement vectors, and inverting said measurement matrix. 

2. A method for correcting a programmed path for a robot manipulator according to Claim 1 wherein 
said measurement matrix is formed so that each row has the following format: 

[h mi ] = [u xm , u ym , u 2m , u zrn y m --u ym z m \ u xm z m "-u zm x m ". u ym x m '-u xm ym*]- . 
where: u^, u ym and u zm comprise the component parts of said unit measurement direction vectors and x m . 
y™" and z m " comprise said world space coordinates. 

3. A method for correcting a programmed path for a robot manipulator according to Claim 2 wherein 
said measurement matrix is inverted according to the decomposition method. 

4 A method for correcting a programmed path for a robot manipulator according to Claim 1 wherein 
said offsets are measured at a plurality of waypoints extending along a path which is to be followed by said 
robot manipulator. , . 

5 A system for correcting a programmed path for a robot manipulator to compensate for vanab.lity in 
the location of a workpiece, comprising, means for sensing and measuring path offsets between the 
idealized location and the actual location of said workpiece at a plurality of waypoints, means for converting 
said measured offsets into translations and rotations of the workpiece by multiplying a matnx comprised of 
said offset measurements by a previously prepared conversion matrix, means for correcting the coordinates 
of waypoints within said preprogrammed path by applying said translations and rotations to said coordi- 
nates means for transforming said corrected preprogrammed path coordinates into machine contro 
coordinates, and means for providing a controller for said robot manipulator with said machine control 

coordinates. u 

6 A system according to Claim 5. wherein said means for sensing and measuring path offsets 
comprises a single structured light device which projects a plane of light upon said workpiece and a single 
camera which determines the position of said workpiece. 

7 A system according to Claim 5 wherein said means for sensing and measuring path offsets 
comprises at least one unstructured light device which projects light upon said workpiece and a plurality of 
cameras which determine the position of said workpiece. 
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© Method and system for a robot path. 



© A method and system for correcting a pro- 
grammed robot manipulator path to compensate for 
variability of the location of a succession of work- 
pieces includes the steps of sensing and measuring 
path offsets between the idealized workpiece loca- 
COtion and the actual location of the workpiece at a 
^plurality of waypoints, converting the measured off- 
f*)sets into translations and rotations of the workpiece 
CO by multiplying a matrix comprised of the offset mea- 
^surements by a previously prepared conversion ma- 
v— trix. correcting the coordinates of waypoints within 
CO the preprogrammed path by applying the transla- 
tions and rotations to such coordinates, transforming 
©the corrected preprogrammed path coordinates into 
^machine control coordinates, and providing a con- 
Qjtroller for the robot manipulator with such machine 
control coordinates. 
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